DIAGONAL VECTORS OF SHIFTED YOUNG TABLEAUX 



DORIAN CROITORU 



Abstract. We study vectors formed by entries on the diagonal of standard 
Young tableaux of shifted shapes. Such vectors are in bijection with inte- 
ger lattice points of certain integral polytopes, which are Minkowski sums of 
simplices. We also describe vertices of these polytopes, and construct corre- 
sponding shifted Young tableaux. 



1. Shifted Young Diagrams And Tableax 

Definition 1. Let A = (Ai, . . . , A„) be a partition with at most n parts. The shifted 
Young diagram of shape A (or just X-shifted diagram) is the set 

D x = {(i, j) e R 2 \ 1 < j < n, j < i < n + A,} . 
We think of D\ as a collection of boxes with n+1 — i+Xi boxes in row i, and such that 
the leftmost box of the i th row is also in the i th column. A shifted standard Young 
tableau shape X (or just X-shifted tableau) is a bijective map T : D\ — > {1, . . . , \D\\} 
which is increasing along rows and down columns, i.e. T(i,j) < T(i,j + 1) and 
T(i,j) < T(i + l,j) (\D X \ = ("J 1 ) + Ai + • • • + A„ is the number of boxes in D\). 
The diagonal vector of such a tableau T is diag{T) = (T(l, 1), T(2, 2), . . . , T(n, n)), 

Example 1. The following is a shifted standard Young tableau for n = 4, A = 
(4,2,1,0). Its diagonal vector is (1, 4, 7, 17). 
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We are interested in describing the possible diagonal vectors appearing in A- 
shifted Young tableaux. The problem was solved in the case A = (0, 0, . . . , 0) (the 
empty partition) by A. Postnikov, in |Pos[ Section 15]. Specifically, it was shown 
that diagonal vectors of the shifted triangular shape Dq are in bijection with lattice 
points of the (n — l)-dimensional associahedron Ass„_i(to be defined in section 
2). Moreover, a simple explicit construction was given for the "extreme" diagonal 
vectors, i.e. the ones corresponding to the vertices of Ass n _i. 

In this article, we aim to generalize Postnikov's results to arbitrary shifted 
shapes. Specifically, in section 2 we will prove that diagonal vectors of shifted 
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A-tableaux are in bijection with lattice points of a certain polytope Pa- This poly- 
tope is a Minkowski sum of simplices in R" and its combinatorial structure only 
depends on the length of the partition A. In particular, if the length is n, Pa 
turns out to be combinatorially equivalent to Ass„. In section 3 we shall give an 
exlpicit construction of A-shifted tableaux whose diagonal vectors coorespond to 
the vertices of Pa- 

For a non-negative integer vector (a%, ...,a n ), let N\(ai, . . . , a n ) be the number 
of standard A-shifted tableaux T such that T(i + l,i + 1) — T(i, i) — 1 = <2j for 
i = 1, . . . , n, where we set T(n + 1, n + 1) = ( n « ) + Ai H h A n + 1 . 

Theorem 1. We have the following identity: 

£ N x (a 1 ,...,a n )%--- t ^- = 
^— ' . n ail a n l 

a\,...,a n >() 



l 



J| {U + ---+ tj-x) •*>(*! + ■•• + t». *a + • • • + *n, ■ ■ ■ , t n ) 



nr=i(A,+n- 

where s\ denotes the Schur symmetric polynomial associated to A. 
Proof. Consider a vector x = (xi > a; 2 > • • • > £E n ). Define the polytope 



P A (x) = {(pij)(i,j)eD x I < Pij > Pi( j+ i), Pij > P(i+i)j, Pn = 2:;}- 
Thus Pa(x) is the section of the order polytope of shape D\ where the values 
along the main diagonal If A = 0, this polytope is known as the 

Gelfand-Tsetlin polytope, which has important connections to finite-dimensional 
representations of fll ra C (see |GT| ). Our proof strategy is to compare two different 
formulas for the volume of Pa (x) , one of which is more direct and the other is a 
summation over standard A-shifted Young tableaux. By |BR1 Proposition 12], 



(1) V0l(P X (x)) = n — — • J] (Xi -Xj) ■ s A (x). 

On the other hand, there is a natural map <j) from Pa(x) (defined except on a set of 
measure 0), to the set of standard A-shifted Young tableaux, given as follows: Let 
P ~{Pij){i. j)eD x e -F"a( x ) be a point with distinct coordinates. Arrange the p^-'s in 
decreasing order and define the tableau T — </>(p) by writing k in box (i, j) if p^ 
is the fc th element in the above list. By the definition of P\(x), it is clear that T 
is a standard A-shifted Young tableau. Given a standard A-shifted tableau T with 
diagonal vector diag(T) — {di, . . . , d n }, it is easy to see that 0~ 1 (T) is isomorphic 
to the set 

{(yi) e K |T| I yi > V2 > ■ ■ ■ > y\ T \ > 0, y di = ^} 

which is a direct product of (inflated) simplices 



{xi = yi > y 2 ■ ■ ■ > yd 2 -i > x 2 } x ■ ■ ■ x {x n = y dn > Vd n +i ■ > V\t\ > 0} 
Therefore, 
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voi{r\T)) = (xi x t 2)ai x " )a "' 1 ■ 

av. a n -i< a„! 

Summing over all T, we obtain 
vol(P x ( X )) = Y, vol ^ X i T )) 

T 

(xi - x 2 ) Q1 (x n _i - x n ) a ^ a%> 



E N\(ai, . . . ,a n )- 



ail a„_i! 

ai ,. . . ,a n >U 



Comparing the last formula to Jl} , and making the substitutions 

ti = xi — x-2, ■ ■ ■ , t n -i = x n -i — x n , t n = Xn 7 we obtain the identity in the 
theorem. □ 

2. Generalized Permutohedra 

In this section we recall the setup from |Pos| Section 6]. Let n £ N and let 
ei,..., e„ denote the standard basis of R™. For a subset / £ {1,2, ...,n}, let 
A/ = Conv{ei\ i £ /}, which is an |/|-dimensional simplex. A large class of 
generalized permutohedra (cf. [Posl Section 6]) is given by subsets of E™ of the 
form 

p%({vi}) = E vi^i 

0^/C{l,...,n} 

i.e. Pn({yi}) is the Minkowski sum of the simplices Aj scaled by yi > 0. It's 
not hard to see that if yi = y,j, whenever |/| = \J\, then Pn{{yi}) ls the usual 
permutohedron obtained by taking the convex hull of points (xi, . . . , x n ) such that 
permutation of the numbers 

7C[n] 7C[n-l] 

Generalized permutohedra have been studied extensively in [Posj . One particular 
example of a generalized permutohedron, the associahedron , is defined as Ass„ — 
Ei<Kj<n ^[*, j]- ^ ^ s a ^ so known as the Stasheff polytope and it first appeared in 
the work of Stasheff (cf. [Staj .l 

Proposition 1. For any subsets Ii,...,Ik C [n], and any non-negative integers 
<zi, . . . , a„, ifte coefficient of i" 1 • • ■ i^ 71 m 



(2) EE* 

3=1 \ie/j 

is non-zero if and only if (ai,...,a„) is an integer lattice point of the polytope 
E-=iA v 

Proof. It's easy to see that the coefficient of t® 1 ■ ■ ■ t^" in ([2]) is non-zero if and only 
if (ai, . . . , a n ) can be written as a sum of vertices of the simplices Ai 1 , . . . , A/ fc . 
By |Pos| Proposition 14.12], this happens if and only if (ai, . . ., a„) is a lattice 
point of A/j. □ 
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Proposition 2. The coefficient oft^ 1 ■ ■ -t^" in s\(ti + - ■ -+t n , t% + - ■ -+t n , . . . , t n ) 
is non-zero if and only if (ai, . . . , a n ) is a lattice point of the polytope AiAhn] + 
A2A[2,n] H 1- A„A{„}. 

Proof. Recall that 

(3) e x (ti + ---+t n ,t 2 + --- + t n ,...,t n ) = J^(ti + ••• +t n ) Wl ••• C", 

T 

where the sum ranges over all semi- standard Young tableaux T of shape A and 
weight w = (ioi, . . . , w„), i.e. Wi is the number of i's appearing in T (see [St]). Let 
T be a SSYT of shape A and weight w. Then wi+- ■ -+Wi < Ai+- • •+A i , Vi = 1 . . . n. 
Indeed, if we consider the boxes containing the numbers 1, 2, . . . , i in T, there can 
be no more than i of them in the same column. Hence the number of such boxes is 
at most the size of the first i rows of A, which is Ai + \- A,. 

It follows that any monomial t^ 1 ■ ■ ■ t®" appearing in (ti + ■ • • + t n ) wi ■ ■ ■ t™ n also 
appears in (ti H — • + t n ) Xl ■ ■ ■ t„ n . On the other hand, (*! + ■•• + t n ) Xl ■ ■ ■ ^"does 
appear in the right side of (J3j) as the term corresponding to the tableau T with l's 
in the first row, 2's in the second row, etc. Therefore, the coefficient of i" 1 • • • 
in s\(ti + h t n , ti + • • • +t n , . . . , in) is non-zero if and only if it is non-zero in 

+ - • -+t n ) Xl ■ ■ ■ t„ n , which by PropositionQ], is non-zero if and only if (ai, . . . , a n ) 
is a lattice point of AiAn n i + A2A[ 2 ,„] + • ■ ■ + A„A{„}. □ 

Theorem 2. The number of (distinct) diagonal vectors of A- shifted Young tableaux 
is equal to the number of lattice points of the polytope 

Pa := ^ A[.y] + AiA[^„] + A 2 A[ 2 , n ] H h A n A{„}. 

l<i<j<n-l 

Proof. By Theorem [H and Propositions [TJ [2] it follows that N\(ai , . . . , a n ) ^ if 
and only if [a\, . . . , a n ) is an integer lattice point of the polytope 

A[ i;J -] + AiA[ 1>n ] + A2A[ 2>n ] + h A„A{„}. 

l<i<j<n-l 

□ 

In particular, if A has n parts (i.e. A„ > 0), we see that Pa is combinatorially 
equivalent to Ass„. 

3. Vertices of Pa 

In what follows we describe the vertices Pa by using techniques developed in 
[Pos] . Given a generalized permutohedron P%({yi}) = X^/c{i n \Vi^i, as- 
sume that its building set B = {I C [n]\ yi > 0} satisfies the following conditions: 

(1) If J, J e B and I n J ^ 0, then I U J £ B. 

(2) B contains all singletons {i}, for i € [n]. 

A B -forest is a rooted forest F on the vertex set [n] such that 

(1) For any i, desc(i, F) S B (desc(i, F) is the set of descendants of i in F). 

(2) There are no k > 2 distinct incomparable nodes i\,...,ik in F such that 
\J k j=1 desc(i j ,F)eB, 

(3) {desc(i,F)\ i- root of F} = {I E B\ /-maximal}. 
We will need the following result of Postnikov: 
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Proposition 3. |Posl Proposition 7.9] Vertices of P%({yi}) are in bijection with 
B-forests. More precisely, the vertex vf — (ii, ■ ■ • ,t n ) of P%({yi}) associated with 
a B-forest F is given by U = £ JeB: ieJCd esc (i,F) VJ> f or * e W- 

Remark. It's not hard to see that Proposition [3] remains true even if we allow the 
building set B not to contain the singletons {i}. We will make use of this later on. 

The combinatorial structure of Pa clearly depends only on its building set, i.e. 
the number of non-zero parts of the partition A. Assume Ai, . . . , > 0, A^+i = 
• ■ ■ = A„ = 0, so that the building set of Pa is 

B k = {[*, j]\ l<i<3 <n-l}U{[*, n}\ l<i<k}. 

We first deal with the case k = n. Let T be a plane binary tree on n nodes. For 
a node v of T, denote by L v , R v the left and right branches at v. There is a unique 
way to label the nodes of T such that for any node v, its label is greater than all 
labels in L v and smaller than all labels in R v . This labelling is called the binary 
search labelling of T. 

Proposition 4. [Pos^ Proposition 8.1] The B n -forests are exactly plane binary trees 
on n nodes with the binary search labeling. 

Let T be a -B„-forest. It's easy to see that desc(x, T) has form [a, n] if and only 
if the path from the root to x always goes to the right. In this case, desc(a;,T) = 
[n— \L x \,n] and n— \L X \ is maximal when x is the right-most node in T, i.e. x = n. 
It follows that {desc(x,T)| x s [n]} C _B fc C B n <^ \L n \ > n — k, This argument 
together with Proposition [4] implies 

Proposition 5. The B^-forests are exactly plane binary trees on n nodes with the 
binary search labeling and such that \L n \ > n — k, i.e. such that the (left) subtree 
of the right-most node in T has size at least n — k. 

Corollary 1. The number of vertices o/Pa is 

where C n = ^rf ( 2 ^) denotes the n th Catalan number. 

Proof. By Propositions [3] and OH the number of vertices of Pa is equal to the number 
of plane binary trees T on n nodes such that left subtree L of the right-most node 
in T has size at least n — k. If \L\ = n — i, then there are C n -i ways to choose L 
and d ways to choose the tree T\L. Summing over 1 = 1,..., k yields the desired 
formula. □ 

To describe the vertices of Pa , recall that plane binary trees T on n nodes are 
in bijective correspondence with the C n subdivisions of the shifted Young diagram 
Dm into n rectangles. This can be defined inductively as follows: Let i be the root 
of T (in the binary search labeling). Then draw an (\Li\ + 1) x (\Ri\ + 1) rectangle. 
Then attach the subdivisions corresponding to the binary trees Li, Ri to the left 
and, respectively, bottom of the rectangle. 

For a subdivision 5 of D$ into n rectangles, the i th rectangle is the rectangle 
containing the i th diagonal box of D®. If T is the binary tree corresponding to S, 
then the i th rectangle of 5 has size + 1) x (\Ri\ + 1). In particular, \L n \ + 1 is 
the length of the (bottom-right) vertical strip of the subdivision 5. 
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Example 2. Here is a subdivision of D$ and the corresponding binary tree with 
the binary search labeling when n = 4. 
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We are finally in a position to prove the main result of this paper. 

Theorem 3. Vertices ofP\ are in bijection with subdivisions of the shifted diagram 
D$ into n rectangles such that the bottom-right vertical strip of the subdivision has 
at least n — k + 1 boxes. Specifically, let 3 be such a subdivision. Then we can 
get a subdivision 3* of D\-(i k ) by merging the rectangles in 3 with the rows of the 
Young diagram of A — (l k ) that they border. Then the corresponding vertex o/ Pa 
is vs = (tx, . . . ,t n ), where ti is the number of boxes in the i th region o/S*. 

Proof. The first part of the theorem follows from Proposition [5] and the discussion 
preceeding the theorem. To prove the second part, we use Proposition [31 Recall 
that the building set of Pa is Bk — {[i,j]\ 1 < i < j < n} U 1 < i < k}, and 

p A = J2[tj]eB k Vij^liJ] where % = 1 if j ^ 1 and y in = A 4 . Let T be a Bfe-forest, 
i.e. a binary tree on n nodes with the binary search labeling such that \L n \ > n — k 
(cf. Proposition 0) Note that desc(i,T) = [i — \Li\,i+ \Ri\}. Now Proposition [3j 
implies that the correponding vertex Vt = (ti, . ■ ■ , t n ) of Pa is given by 

U = ^2 yj = ^2 yu 

j£B k , i£jCdesc(i,F) [k,l]£B k , i-|£ i |<fc<i<i<i+|.R i | 

i 

= (\Li\ + 1) ■ \Ri\ + yk(i+\Ri\)- 
k=i-\Li\ 

If the i th rectangle of 3 borders the right edge of D$ (i.e. n 6 desc(i, T)), then 
U = (\Li\ + 1) • \Ri\ + Yfk=i-\ Li \ X k- Otherwise, U = (\L t \ + 1) • (^1 + 1) . In each 
case, ti is the number boxes in the i th region of S*. □ 

Example 3. Let n = 4, A = (4, 2, 1, 0), k = 3. The figure shows how a subdivision 
3 of yields the subdivision 3* of £>A-(i fc ) = -D(3,i,o)- The corresponding vertex 
of Pa is given by counting boxes in the regions of 5*: vs* — (1, 10, 1,2). It follows 
that there is a (4,2,l,0)-shifted Young tableau T whose diagonal vector is diag(T) = 
(1,1 + 1 + 1,1 + 1 + 1 + 10+1,1 + 1 + 1 + 10+1 + 2) = (1,3,14,16). 
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On the other hand, one can directly construct A-shifted Young tableaux with 
diagonal vector v-s* = (cx, C2, . ■ ■ , c n ) by using the subdivision S*. Indeed, we know 
what the diagonal vector of the tableau (ai, . . . , a n ) should be. Consider again the 
subdivision S* of D x _^ky We can extend the diagram £>A-(i fe ) to D\ by first 
adding a box to the left of each row of £>A-(i fc )i and then, by deleting the last 
n — k boxes in the n th column of D x _^ky Now, we start by putting a\, . . . ,a n in 
the diagonal boxes of D\. The remaining part of D\ is divided into n regions by 
H*. Finaly, for each i = 1, . . . , n, put the Cj numbers <Zj + 1, . . . , Oj+i — 1 in the i th 
region of S* in a standard way, i.e. such that entries increase along rows and down 
columns (as before, we set a n +i = \D\\ + 1.) In this way we obtain a A-shifted 
tableau T such that diag(T) = (ai, . . . , a„). 

We illustrate the above procedure for the subdivision in Example 03 
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